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An Investigation of Technological Innovation: 
Interactive Television 
Rhonda S. Robinson 

Introduction 

According to Curtis and Biedenbach (1979, p. 3), "Many critics 
believe that education is the only major American industry which 
does not yet make intensive use of modern technologies to reduce 
its costs and to increase the scope of its services." A project 
begun in Illinois in August, 1983 is an attempt to utilize new and 
emerging technologies to increase the effectiveness of the 
educational process. This project, the Carrol Instructional 
Television Consortium, was the first cooperative educational 
program of its kind in Illinois, and was born of the common need 
of four small rural high schools to offer a full range of academic 
opportunity to their students. 

The Consortium utilizes a cable television network already 
serving the four districts. The system permits simultaneous video 
and audio communication between any or all of the four high 
schools. An instructor in one of the four schools teaches class 
as they normally would, except there are cameras, microphones and 
monitoring equipment in their classroom. In the other three 
schools, students watch the lesson and listen to the instructor on 
their own monitors, while being seen and heard by the instructor 
as well as by their counterparts in other schools. The two-way 
television consortium represents a technologically acceptable 
method for sharing instructional resources, better utilizing 



faculty expertise and more fully serving the academic needs of the 

l 

students. 

The project goals of the Carrol Instructional Television 
Consortium are: 

1. To increase the total number of course offerings available to 
students enrolled in the participating districts. 

2. To provide fully qualified, experienced, and effective faculty 
to teach advanced level course work in mathematics, science 
and foreign languages. 

3. To motivate and challenge talented and gifted students through 
association with comparable students from other districts. 

4. To promote high levels of student achievement as measured by 
content mastery of advanced level course work. 

5. To increase the efficiency of teacher instructional time in 
traditionally low enrollment advanced level curricular 
offerings. 

Based initially on these goals, project evaluation was 
designed as a five year process. The research has broadened some 
to include many factors of the environment, and to be as complete 
as poss-'ble. 

Project evaluation of this scope has inherent many problems. 
The subjectivity of observation, the lack of control of population 
or teaching methods, the gaps in communication or cooperation all 
prevented the researcher from utilizing experimental research 
procedures which would add more data to the "N.S.D." comparative 
studies literature. Instead, the design of this research was 



based on naturalistic research premises; the outcomes will be 
non-statistical but rich data about the school environment and the 
project's success. This study employs a naturalistic paradigm to 
investigate a technologically innovative project using two-vay 
interactive television as a vehicle to enhance curriculum. 

Very few projects involving interactive television have been 
researched to date, as the technology is fairly recent. 
Interactive projects' in Trempeauleau County, Wisconsin and at 
Texas A & M University have resulted in some study reports (Hartz, 
1983; Johnson, 1983) which detail the utilization of the 
technology and its success. Project reports show "preliminary" 
data, and show no significant difference between live and 
interactive televised instruction in cognitive growth. 

The Carroll I.T.V. Consortium modeled itself in part after 
the Trempeauleau County project. Evaluation reports from 
Wisconsin were available in the design of the research for this 
proj ec t. 

The previously listed Project Goals are the focus of the 
research. In order to evaluate whether the five goals have been 
achieved, research objectives and data collection methods were 
directed at the goals as well as at more general research 
objectives. 
Purpose 

This paper explains the Carroll Instructional Television 
Consortium, the design of the research being conducted to evaluate 
the project, and the results evident from data collected to date. 
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( >bj vyt iv es of the Study 

This study was designed to determine: 

1. Is an interactive television system effective? 

2. Is the teaching/learning process affected by use of 
interactive television? 

3. Is the interactive television system accepted by the teachers, 
the students, and the school districts? 

4. Are the project goals successfully met? 
Methodology 

A case study was designed to intensively study the status and 
interaction of the participants and this project* Data is being 
collected using several different techniques: 

1. Student cognitive growth is measure by pre- and post-tests in 
their subject matter. 
> 2. Students are surveyed four times during the year to evaluate 
technical aspects of the system. 

3. Teachers are observed throughout the year, approximately 75 
hours in total. 

4. Administrators involved in the innovation are interviewed 
about their dec is ion -making process and their satisfaction 
with the project. 

The cas? study methodology inlcudes many separate data 
collection techniques, as listed. More specifically, evaluation 
and data collection includes: 

1. A comparison of 1984-85 course offerings with 1983-84 course 
offerings in each participating district by the district 
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administrator and researcher, 

2. Periodic assessments of teacher effectiveness by district 
administrators and the researcher, 

3. A survey of student opinion about teacher effectiveness 
conducted by the researcher during each quarter of the 
academic year. 

A. A survey of student attitudes and satisfaction conducted by 
« 

the researcher during the fourth quarter of the academic year. 

5. A survey of teacher opinions about student motivation and 
degree of challenge conducted by the researcher during the 
fourth quarter of the academic year. 

6. Teacher-made tests covering learner objectives identified in 
course outlines utilized for entry and exit level assessments 
of student mastery of course content. 

7. Analyses of student achievement scores made by the researcher 
to assess: 1) student growth, and 2) comparison of 
achievement scores for students located at originating site 
with those located at remote sites, and with those not in TV 
classes where available. 

8 . A comparison made by district administrators of enrollments in 
the televised classes with enrollments in the same classes 
taught in individual districts during the previous two years. 

Thus, the data collection has been triangulated to include 
pre- and post-tests, student/ teacher surveys, and observation and 
interviews throughout the project. Cuba (1981) suggests that 
triangulation can improve dependability and transferability of 
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data collected in naturalistic inquiry. The trustworthiness of 
observation and interview data can be enhanced by the collection 
of survey and cognitive growth data, and by the comparison of 
results gathered by all three methods. 

Further explanation of each data source should provide a 
clearer understanding of the triangulation of data collection ♦ 

Two goals of the Carroll Instructional Television Consortium 
were administrative in nature: to increase total number of course 
offerings in the four schools and to increase teacher 
instructional time efficiency. With high school populations under 
200, the total number of courses offered each year is limited. 
Each administrator provided the number of classes offered per 
school and the teacher assignments, and provided any "paper trail" 
of bourse selection procedures and class assignments (meetings 
with counselors, teachers, and students). Thus, administrator 
information documented the change in total number of courses 
available and in teacher/student ratio indicating teacher 
efficiency. 

A third goal of the project was to provide advanced students 
with effective, experienced teachers. Some schools had no 
qualified foreign language or business teachers, and others had no 
fully qualified advanced science teacher. In order to evaluate 
teacher effectiveness over the system, an observation instrument 
and schedule were developed. Teachers received five days of 
in-service training prior to the initiation of the system, and 
discussion during those sessions was utilized to help develop the 
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teacher observation instrument. Also, materials from a variety of 
teacher observation forms were utilized as a guide to rating 
effective teaching techniques (Salome, 1977)* Elements of 
teaching effectiveness via television were drawn from reports of 
T.V. teaching studies (Hartz, 1983) and from observation during 
practice sessions over the system equipment itself* Since 
teachers were concerned about student perceptions of the course 
instruction, especially the opinions of "distant 11 students, 
questions were added to the student survey dealing with content 
presentation and teacher accessibility. Interviews with 
administrators included teacher effectiveness ratings. 

The last two goals of the project involved the real 
beneficiaries of the system- the students. These goals were to 
motivate and challenge talented students through enhanced 
opportunities to interact in upper level courses with other 
advanced students, and to promote high levels of achievement among 
these students. In order to collect data related to student 
motivation, questions were added to the observation instrument, 
the student survey, and all interview instruments. Pre- and 
post-tests were designed to indicate levels of student 
achievement, and to facilitate comparison between student 
achievement, both in televised and non-televised classes where 
available, and between on-site and "distant" students in any given 
class. Pre- and post-tests were developed by the classroom 
teachers, and were often similar to or the exact final exam given 
normally in the course. Teachers administered these exams during 



the first and last week of classes to all their television 
students, and to non-televisioh classes whefe available. 
To summarize, project goals were used to direct^ data 

c 

collection methods. Where possible, triangulated methods were 
designed to collect data using more than one method. Observation, 
survey, and interview were all selected to provide the richest 
possible data collection and to improve dependability and 
transferability of data collected. All instruments were developed 
by the researcher and project participants utilizing discussions, 
notes from in-service training, and earlier project reports to 
generate some elements of the instruments. 
Results 

Results are discussed based upon project goals. Only 
preliminary data is available, since evaluation will continue 
throughout the initial five-years of the project* The first 
year f s data has been collected and partially analyzed based upon 
the project goals ai\d study objectives listed previously. Data 
was collated from all three sources, and the strength of the data 
across sources was one area analyzed. However, the first year's 
data is inconclusive alone, and no statements as to the project's 
success should be inferred from this preliminary year. 
Project Goals; 

A) Increase course offerings and teacher efficiency. 

Each administrator reported the number of course offerings 
available to their students. The largest school increased only in 
number of sections of a course; no new courses were added. The 



other three schools increased their course offerings by one to 
three courses per school, with the smallest school increasing the 
most* Teacher effiency was increased In each school. 



Instructional time for small classes (3-6 students) was judged as 
inefficient in previous years. All schools increased class sizes 
or teacher/ student ratio by adding students from the other three 
schools to the student population "pool" for advanced classes. 

B) Provide students with effective teachers. 

Teacher effectiveness was extremely important to the project. 
Teachers were selected by their administrators based upon their 
years of experience, professional preparation, personality or 
teaching style, and willingness to participate. In-service 
activities focussed on mastery of the television equipment and 
adaptation of lesson plans to television . Teacher effectiveness 

i 

in the first year was evaluated based upon observation, interview, 
and the student survey. (See Appendix I for observation 
instrument and student survey.) 

Observation data indicated that the teachers were effective 
in managing the television equipment, materials distribution, and 
course structure in their televised classes. Observation of each 
teacher focussed on their use of the system and their teaching 
style, class organization, and communication abilities such as eye 
contact, questioning and feedback. Teachers were rated on these 
elements, and the ratings indicated growths and improvement 
throughout the year. 

The student survey indicated satisfaction with teacher 
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effectiveness (See Appendix 2). On a 1 e poor to 5 « excellent 
scale, teacher effectiveness and accessibility were rated by 
students. Improvement was noted, especially in accessibility 
(from an average of 3.45 in October to 4,29 in April). Ease of 
comprehension of material presented was rated an average of 3.72 
in October and 3.77 in April, so some improvement was noted. 
Teacher and student interviews revealed a wide range of 
satisfaction with teacher effectiveness, much of which varied from 
school to school and resulted from technical systems operation 
problems and student opinions of the system rather than the 
teacher. Interview data was the most interesting but was also the 
most difficult to collate, as personalities and indivdual grades 
etc. effected the evaluation of effectiveness. 

Teacher effectiveness was perceived by all three data sources to 
be above average. However, teacher effectivenss is extremely 
difficult to evaluate, and the data has not been completely 
collated. 

C) Motivate students and promote high levels of achievement. 

Student motivation was indicated by observation and 
interview. No observed comparisons to student motivation in 
regular classrooms were available, but participantc were asked zo 
compare regular to televised classes* 

Motivation vas indicated by participation and by ease of 
understanding on the student survey (Appendix 2) . These two 
elements av* t 3.49 and 3.77 respectively in April. These 

figures incix^ -fiat students felt their participation was only 
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average, but that their comprehension was above average by the end 
of the school year. 

Student achievement data was collected using all three 
methods. The pre- and post-test scores were somewhat 
inconclusive, due to some problems of administration and scoring. 

* vur, average class "gains" in scores on the test indicated 
hat students were learning, and that in several classes, students 
in "distant" classrooms improved more than those in the teachers 1 
own school. Individual gain and average class gains for each 
class were recorded for future comparisons. In the second year, 
comparisons w5t ; :v n-televised classes will also be available. 
In summary, preliminary results have indicated: 

1. Student evaluations of technical considerations showed that 
the system itself improved during the first year; 

2. Teachers improved in both effectiveness and efficiency 
throughout the year; 

3. Administrators ai*d other faculty perceptions showed increased 
satisfaction with the system in the first year; 

4. Students in remote interactive television classes achieved as 
well on the post-test as students in live classrooms. 

Discuss ion/ Summary 

This research was designed as a five year case study, to 
intensively analyze the status and infraction of the project and 
its participants. The objectives of th* study were to determine 
1) the effectiveness of the system; 2) the effect of the system 
on the teaching/learning process; 3) the level of acceptance of 
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interactive technology, and 4) the success of the project. 

The use of naturalistic inquiry in pursuing these objectives 4 
provided for the collection of data in a triangulated design. 
Data collection has proceeded with all three sources of data 
providing in-depth and detailed results. Observation has proven 
the richest source of data; pre- and post-tests were the least 
reliable source in the first year. 

The instruments and their method of administration were 
altered for the second year of data collection. More questions 
were added to the student survey, and the researchers had better 
control of the testing process. These changes should improve the 
caality and quantity of data collection. 

Naturalistic inquiry is a process, not a static technique. 
Research utilizing multiple data collection techniques including 
observation has particular strengths and weaknesses. As a 
methodology, naturalistic inquiry will not definitively prove that 

this sytem is wore effective than a live teacher, or that 

» 

interactive television is better than or less effective than other 
instructional delivery systems. The cognitive growth of 
individual students measured using more sytematic methods would be 
more quantifiable. 

The advantage of this inquiry technique is that it _is a 
prccess. Mich is learned during the data collection about the 
techniques employed. The quantity and detail of data collected is 
extraordinary, and the possibilities for collating and reporting 
are challenging. The study herein describe should provide 
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reliable, detailed dala addressing the four objectives. The 
richness of the data will provide even more than is required for 
the continuation of the project, and will certainly establish the 
level of success of the project relating to its five project 
goals. 
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Appendix 1 
Part 1 



MEMORANDUM 

TO: TV Students - Chadwick, Lanark, Milledgeville and Shannon 

DATE: May, 1384 

RE: Evaluation of system 

Now that the television system has been operational for close to a year we would 
appreciate an evaluation of your experience taking a course via this method. 

Please rate on a scale of 1-5 

(1 - poor, 2 « below average, 3 «= average, 4 - above average, 5 » excellent) 

Make additional comments you care to. 

Course: . Instructor: 

Your school: . _ , 



1. Was the reception of the picture good enough for following the lecture, 
copying materials, etc? 

(1-5) 

2. Was the audio satisfactory? 

(1-5) 

3. Do you feel that the talkback feature allowed you to participate effectively 
in the class? 

(1-5) 



4. Was the instructor accessible to you outside of regular class time? 

_____ (1-5) 



5. Hava you been receiving hand-outs, and other materials form the instructor 
in time for assignments? 



(1-5) 



6. The material presented in this class has been as easy to follow as material 
presented in regular face-to-face classes? 

(1-5) 

7. Additional comments. 



Ill 



I'jrt 2 



Evaluation of Teaching I or f <>t num.*: ove r Inter ac t I ve Television 



E valuator I rom what site 



Teacher Class originates 

Class Date 



Section I - Equipment (system) evaluation 

1. Is starting class a problem because of 
equipment set-up. 

3 

2. Does the teacher run an audio and video 
check before class. 

3. Are there problems with audio? 

4. It yes, please describe. 



Low Hiph 
1 2 3 4 5 



Yes 



No 



5. Are there problems with video? 

t>. If yes, please describe those problems. 



Yes 



No 



7. Does the teacher make effective use of the 
special effects generator (SEC). 

8. How could the teacher make better use of the SEG? 



BEST COPY AVAILABLE 
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Low Hif,h 

9. Does it appear any pjrt of the '..yuluiii K 12 3 4 5 

interfering with the teach iwi/ learning process. 

10. Please discribe how the system is interfering 

with the teaching/ 1 earning process if applicable. 



11. Does It appear the students are reluctant 12 3 4 5 
to participate in class because of the system? 

12. Are the students capable of "trouble— -*lioot i ihj" 12 3 4 5 
the system? 

13. If not, what are some of the problem-.. Hie 
students are encountering, and at what sife? 
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Section, i - Instructional style 

How does the teacher come across on the system. 

14. Personal traits - projects tjck, patience, 12345 
freedom from mannerisms, etc. 

Voice - clearness, deci si venoms. 1 2 3 4 5 

pleasantness 

lu. Language usa^e - oral Lngli^h, 1 2 3 4 !> 

handwriting, spelling 

Content ski I Is ^ 

17. Knowledge of subject, knowledge of fluid, 1 2 3 4 5 
ability to develop ideas, 

18. Planning learning activities - development 12 3 4 5 
of objectives in terms of pupils growth in 

knowledge and understanding of subject. 

19. Teaching techniques -organization of subject 12 3 4 5 
matter, stimulation of student learnlnq. 



BEST COPY AVAILABLE 
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Low 



Hip,h 



20. 


Presentation skills - recognition of 1 
individual differences, variety of 
techniques, clarity. 


I 


3 


4 




Oid the instructor use good personal technic tics for: 










21. 


gaining and holding attention 1 


Z 


3 


A 
*♦ 


J 


22. 


questioning 1 


2 


* 

3 


4 


-> 


23. 


reinforcing « 


2 


3 


4 




24. 


clarifying and explaining » 


2 


3 


4 


5 


25. 


giving directions t 


2 


3 


4 


5 


2b. 


use of student ideas 1 


2 


3 


4 


5 


27. 


physical (eyes, voice, language, 1 
lack of tension, enthusiasm, movement) 


2 


3 


4 


5 


28. 


Did the instruction fit the time 

constraints. 1 


2 


3 


4 


5 


29. 


Were there clearly defined objectives. 1 


2 


3 


4 


5 


3J. 


Were the objectives meet? I 


I 


3 


A 

4 


-> 


31. 


Was there effective closure? 1 


2 


3 


4 


5 


Section 3 - Misc. 










32. 


Does it appear the teacher is available 

to work with the students after class? 1 




3 


A 
«♦ 


5 


33. 


Oid the instructor use supplemental 

materials? * 


I 


3 


A 
H 




34. 


Did the Instructor allow students to 

participate in class? ' 


7 


3 


4 


5 


35. 


Is too much time being spent on record 

keeping? * 


2 


3 


4 


5 


3b. 


Does teacher take time to explain complex 
concepts? ' 


2 


3 


4 


5 
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37, Ho* long was this class (in minutes) 

3tt. Approximately ho* much dead time is there? 
(no Instruction before, during ond after 
class). 

39. Were there unusual or creative touches 
which caused the teacher to stjnd out? 



Ob" 40, Other comments. 
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Ovcr;i 1 I-Sumiu.iry 
10/25/83 



1. Was the reception of the picture good enough for following the lecture, 
copying materials, etc#? 3. 9 

2. Was the audio satisfactory? 3. i 

3. Do you feel that the talkback feature allowed you to participate effectively 
in the class? 3.8 

4. Was the instructor accessible to you outside of regular class time? 3,6 _ 

5. Have you been receiving hand-outs, and other materials from the instructor 
in time for assignments? 4.4 

6. The material presented in this class has been as easy to follow as material 
presented in regular face-to-face classes. 3. 9 



Comments: 

In general, the majority of the students enjoyed and found the class interest- 
ing; allowing them to experience a broader curriculum. 

The most common of negative feedback was that there are problems with the 
audio and picture reception at times. 

Other comments included; the need for another Spanish educated person, other 
than the instructor, in the class and that the program should be used for smaller 
classes with approximately eight students at the maximum. 
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0 vc mil- S urotnn ry 
(Teacher Present) 
10/25/83 

1. Was the reception of the picture good enough for following the lecture, 
copying materials* etc.? 3, 7 

2. Was the audio satisfactory? 3.3 

3. Do you feel that the talkback feature allowed you to participate effectively 
in the class? 3. 3 

4. Was the instructor accessible to you outside of regular class time? 4. 4 

5. Have you been receiving hand-outs, and other materials from the instructor 
in time for assignments? A. 3 

6. The material presented in this class has been as easy to follow as material 
presented in regular face-to-face classes. 3.5 
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Overall-Summary 
(No Teacher Present) 
10 '25/83 

1. Was the reception of the picture good enough for following lecture, 
copying materials, etc.? 4 . 1 

2. Was the audio satisfactory? 3. 1 _ 

3. Do you feel that the talkback feature allowed you to participate effectively 
in the class? 4.3 

4. Was the instructor accessible to you outside of regular class time? 3. 3 

5. Have you been receiving hand-outs, and other materials from the instructor 
in time for assignments? 4.4 

6. The material presented in this class has been as easy to follow as material 
presented in regular face-to-face classes. 4.1 
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CARROLL INSTRUCTIONAL TELEVISION CONSORTIUM 

Student Survey 
1984 - 35 



Your School Did you take a TV course 

last year? 

Instructor , - v ^ 



Course u No 



*************************************************************** 

Please rate the following questions on a scale of 1 - 5 (l=poor, 2=below 
average, 3»average, 4 a above average, 5=exce11ent), and make any 
additional comments you care to. 

1. What was your opinion of the TV classes before this class? 

□ no opinion o poor Idea a average idea o above average idea 

2. Why did you have that opinion? 



3. Was the reception of the picture good enough for following the 

lecture, copying materials, and taking notes? {1-5) 

4. Can you hear the instructor, and the students 1n the other 

schools? (1-5) 

5. Do you feel that the talkback feature allowed you to 
participate as effectively 1n this class as in regular 

classes? (1-5) 

6. Do you feel as comfortable learning from the TV teacher 

as you do from a -teacher 1n a regular class? ( 1-5) 

7. Is the teacher accessible to you outside of regular class 

time? (1-5) 

Please describe when and how the teacher is accessible to you. 



8. Do you feel you have' an opportunity to get to know your 
classmates from the other schools as well as you get to 

know your classmates in a regular class? . (3-5) 

9. Have you been receiving hand-outs and other materials 

from the teacher in time for assignments? (1-5) 



1 
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10. Do you feel the material presented in this class has been 

as easy to follow as material presented in regular classes? (1-5) 

11. How well do you like the TV class? (1-5) 

12. In general, how well do you like school? (1-5) 
Are there any additional conments you would like to make? % 



\ 



Thank you for your time and effort. 
Please return this survey to your teacher. 



I 

t 
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Appendix II 
STUDENT FEEDBACK/ ASSESSMENT 



An evaluation of the television system was administered to participating 
students 3 times during the academic year (1983-d4) . Each time they 
were asked to respond to 6 questions concerning logistical and technical 
considerations of the system. Using a scale of 1 - 5 (l=poor, b=excel lent) 
they were asked to rank each question. The following are the questions 
and their corresponding results. 

Question #1 

Was the reception of the picture good enough for following the lecture, 
copying materials, etc.? 

October February April 

3.85 3.59 3.70 

Question #2 

Was the audio satisfactory? 

3.13 3.20 3.49 

Question #3 

Do you feel that the talkback feature allowed you to participate 
effectively in the class? 

3.67 3.35 3.49 

Question #4 

Was the instructor accessible to you outside of regular class time? 
3.45 3.58 4.29 

Question #5 

Have you been receiving hand-outs, and other materials from the 
instructor in time for assignments? 

4.24 4.29 4.69 

Question #6 

The material presented in this class has been as easy to follow as 
material presented in regular face-to-face classes? 

3.72 3.46 3.77 
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